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ABSTRACT 

The first of several on-going tests was conducted of 
the Behavior Descriptor Index (BDI) which is a new behaviorally 
oriented jo'b performance appraisal and training evaluation instrument, 
developed for five large Canadian chartered banks. The new instrument 
was shown to be valid across organizations. Twentyfive assistant 
bank managers in these five banks wer*e evaluated by their superiors 
using the BDI as well as the Graphic Rating Scale and: the 
Behaviotally Anchored Rating Scale (BARS) . Three conclusions were 
drawn fuoothe results of this study. First, behaviorally oriented 
scales need not be organization specific. Second, it is possible to 
improvfe the psychometric characteristics of Behavior oriented scales 
by switching from a Likert-type scale with specific anchor points to 
arn anchorless format* whiqh allows the use .of the total job' behavior 
domain. And last, it is possible to use BDI information as a basis 
for a personnel management system because of its favorable rating 
characteristics, the increased utilization of job information, and 
the very specific feeA^ack to raters, evaluatcrs, and ratees. ita) 
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ABSTEACT 



A new behaviorally oriented performance appraisal and training 
evaluation instrument was developed for five large Canadian chartered 
banks, ''The new ins\rument has the' advantage that It is valid across 
organizations,^ Twenty-five assistaiit bank managers were .evaluated by 
their superiors,, using three different appraisal, instruments: Graphic 
Rating Scale,. Behaviorally An choredj Rating Scale, and Behavior 
Description Ihdex, Campbell and Fiske's Multitrait-multlmethod matrix 
was used to test 'the construct validity of the threjb tests employed • 
The Behavior Description Index demonstrated signif icarit^fonVergent- and 
discriminant validity. In additioA, it showed les^ halo 'and antral 
tendency, and had a higher information- contfefit'than tlie other 
instruments. Implications of the findings are discussed. 



.Although the use of personality traits as criteriar^for performance 
appraisal is still dominant, behavior oriented measures of job, performance 
have become more and.mWe popular [Campbell, DunnettE^ ,Lawler , and Weick, 
1970, p. 64]. One o^ the first techniques .utilised in this field was ' " 
Flanagan's Critical Incident method [Flanagan, 1954]. He defined the 
critical requiremeirt-«-t:jt a. job as those 'behaviors which are crucial in 
making a difference, between doing'a job effectively and doing it" 
ipef festively. This technique was expanded and, modified by Smith and 

9 

Kendall [1963] and Campbell, et al. [1970], and is now better known as 
Behavlorally Anchored Rating Scale (BARS), or Behavior ExRecfeation 
Scale (BES) [Zedeck and Baker, 1972; Bernandin, LaShells, 5mlth, and 
. Alvares, 1976].^ 

According to Dunnette [1966],, the behavioral approach to performance 
appraisal reduces much of the ambi-guity of trait ratings by reducing the 
performance construct to the job itself (see also Harari and Zedeck, 
1972). This desirable* characteristic of behavioral scales^s empirically 
supported by Fogli, Hulin, and Blood's [1971] and Smith^and Kendall's 
[1963] generally high interrater agreement (r > .97) ori^the scale value 
assigned to behavioral descriptions and by the conceptual unidimensionality 

of behavioral incidents within scales [Campbell^ et al., 1970]. 

^ • * ( 

'Blood [1974] points to several positive ="spin-off" effects from 

» 

the use of behavidrally oriented scales: ^(1) It^ extends the^domain . 
of evaluated performance. As Borman [1974] has demonstrated, when 
performance evaluation scales are developed at different levels in an 
organization (superior, peers, subordinates) it is possible td get 
different behavioral dimensions 'from each group. Using as many 
organizational perspectives' as possible (e.g. even clients) would 



considerably brdaden the job behavior, domain • ^(2) .It.helV^ to develop 
training programs (see also -Campbell, Dunnette,^ Arvey,,and H^li^rvik, ^ 

1973). Since skills required on the job are describ'ed in -specific 

~ ' V ' » 

behavioral terms — as^coippared to the* name of a skill domain — shortcomings 

axe jnuch easier identified and specific training programs can be 

developed^ In addition, since behavior description can -be stated in 

negative ways, trainers are able to specify unwanted behaviors trainees - 

should learn to ayoiji^ (3) It enables^ assessment 6f agreement on 

organizational policy. This is possible because,' for scale development, 

behavioral items are rated according to the level of performance they 

des^cribe•^ It^ms with a large variance are usually discarded^ However, 

these items may be the most impqrtanj: ones-for organizational development, 

because they may pinpoint areas of organizational policy which are 

unclear*, or^may even point to areas of conflict • (4) It helps to assess 

the accuracy of communication of^ organizational policy. The mean item 

ratings can be collected from member^ of different organizational levels;- 

e^g, 'foremen and workers, and ^compared as to their agreement. If both 

groups disagree on the desirability of specific behaviors, ' then obviously 

there is^ a communication /problem which should be corrected. 

D'espite the intuitive appeal of behavior oriented scales [Bernardin, 

LaShells, ^mitfi", and Alvares, 1976; Bernardin and Walter, 1977; Zedeck; 

Jacobs, and Kafry, 1976], and other suggested advantages [Zedfeck, Imperato 

Krausz, ' Oleno, 1974], recent reviews of the literature [Schwab, Heiieman, 

and DeCotiis, 1975; Schwind, 1977] have not been enco\iraging; By 

'comparing behavior oriented scales with Graphic Rating Scales (GRS) 
and/or Symmated Rating Scales (5RS), ^researchers found either no or only 

tmodest^ superiority of BARS over GRS, or SRS and,-Jbacause of that,^ 



questioned the j us tlf legation for the Investment of the vast amount of 
time and efforj;, required- for th§ development of BARS (Borman and " 
' Dunnette^ 1975] .' \ ' ' 

One of the major shortcomings of BARS seems to be. the waste of 
valuable information [Schwabi et al. , 1975J Schwlnd, 1977]. ~After the 
jievelopmept or collection of critical incidents for a certMn job, 
they are put through the validation, retranslation, and rating process, 
and they must fulfill the standard deviation criterion [Smith and 
Kendall, 196^h Usually 20 to 50 critical incidents per, job dimension 
survive. Yet]only between 5 and 10, depending on the number of anchoring 
points of the scale, are utilised, all others a^fe discarded.. Undoubtedly 
those it^ms which are not used contain valuable information about ^ 
job. dimension to which they were attributed in tje retranslation process. 
The decision to eliminate them Is" made on the basis of arbitrarily 
, cHose*^ criteria: a convenient mean value to fit the scale points, and • 
the degree of -agreement between raters as measured by the Standard 
deviation. • * - . . • ' 



A New Performance Evaluation Scale: 
The Behavior Description Index (BDI) j 

In..,order to improve the rating characteristics of behavior oriented ! 

scales and reduce their shortcomings, a new scale is proposed, based on j 

descriptions of critical job behavior incidents. The development of „ 

thesfe incidents is similar to' the development of incidents for BARS 

(write-up, validation, retranslation) but 'the rating of the incidents 

from very ineffective to extremely effective is dropped, instead of 

selefctina 5, 7 or 9 incidents per job dimenslSn (dVending on the * 

number* of scale points chosen) the selection of a larger number of 



behavioral incidents is suggested, the liinit being determined only by 
the capacity—and willingHess~of raters to read through and check off 
•a certain amount of .behj^vior descriptions. T^sts.so far have shown * 
that ^ters are quite willing to check off 20 or 30 'items per scaie, 
with a total of 5 scales. It is expected that 30 or 40 items per scale 
may be optimal, since an increase in numbers of items very likely wil,l 
trigger a fatigue effect in raters, resulting in such negative rating 
characteristics as halo and leniency. ' 

The beh^ior incidep^ are listed randomly, each with a check-off 
column on the right side of the page (see Exhibit I). The rater responds 
to the question: "Does the t^tee exhibit the described behavior 
consistently (all the time)?" or, in .the case' of an ineffective behavior 
sample: "Does the ratee, exhibit the described behaviol: at all ^" The 
responses (ratings) Can either be evaluated individually to determine 

specific weaknesses, or can be converted"^ into point scores. Of couifse, 

\ 

the responses can be given any weight the rater (or the eyaluat;or of 

'f ' • ^ 

the ratings) desires*, i A simple solution would be to attribute one point 

to a positive response given to a positive item (a desirable behavior 

i'^ 'exhibited consistently), similarly to a negative response given to 

a negative item (an undesirable behavior is not exhibited). A positive 

res'ponse to a negative item (a negative behavior is e^iblted), and 

a nega^tive response to a positive item (a positiye behavior is not 

exhibited consistently) would result in zero points. A superior could 

'determine in advance what scores would be acceptable. or unacceptable; 

e.g. out of 30 possible points (assuming that 30 behavior samples were - 

chosen Iper scale) :- 
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0-15 may mean: urgent training requited 

Xor, If measured after training; training Ineffective) 

16 - 20 may mean: training* recommended ' 

21 - 25 may mean; refresher course may be useful 

26 - 30 may mean: no training required 

. — . . • 

^ . ' ^ r 

Method ^ 

Development of Job Behavior Sailiple 

Five large Canadian chartered banks wBre Involved in the development 
■*«^ 

and validation of the new scale. Since. the use of the scale was planned 
primarily to.be in the training evaluation area, it was agreed upon 
between the investigator and the 5 training managers of the banks to 
select as *a target group assistant branch managers, since their job 
position required a lajrge amount of continuous training. The .training 
, managers, themselves having been for at least ^wo years in an assistant* 
bxyanch manager's position, determined that this job had 5 main aspects 
which could be described as : 

1. Administration : ^ quarterly analyses, monthly reports, 

rbutine wbrk^ branch security, internal correspondence, 
correspondence; with other banks, co-operation with 
manager, supplies, housekeeping, repairs. 

2. Customer Relations ;, complaints, correspondence/ special 

service (counseling in complex matters^, service 

maintenance, 8|)eclal ei^rts. 
3* Marketing : advertising, disftlay material, local campaigns, 

open house, marketing of ba^k services. 
^* Personnel Administration :\ salary admlnistraLion, 

performance appraisal, hiring and firing, disciplinary 



actions, motivation, encouragement, moral support, 
personal problems, vacation and holiday scheduling. 
5., Training: any job-related training and development 

activity, explanations, support in problem solving, 
^dvise, informing, up-dating, course scheduling, 
training follow-up.- 
Workshops were arranged with* all 5 banks, attended by 5 b'ranch 
managers, 5 assistant branch managers 5 and 5 bank clerks and tellers. 
The reason- for this group mix was to take' into account every, aspect 
of the job of an assistant branch manager, as pe^rceived by superiors. 



job incidents, and their subordinates. Participants were informed 
aboat the purpose of the study, and\asked to write down examples of ' 
effective and ineffective job behavi^^rs of an assistant bran9h manager. 
Between 600 and 1,000 behavior samples, were collected from each workshop. 
After editing and removal of redundant items, approximately 300 to 400 
items per bank remained. They were listed in random order and submitted 
to groups of 5 judges' (experienced job encixmbants) from each bank. The 
judges were a^ked to determine whether eachUtem yas a valid description " 
of an assistant branch manager 's job behaviorV and secondly, they had 
to categorise each i^em into one of the 5 job-Wmensions mentioned above 
(AdnSiniseration, Cvrstomer* Relations, Marketing, Ve^sonnel, and Training) . 
Items were retained if 80% of the jnidg^greed ^ their validity and * 
category.* Approximately *80 to 150 behavior sample^ survived this, process.. 
•These items were' listed again, this time ordered in\:o their respectiv^ 
categories, and sent to a second gr^up consisting of\25 judges (in all 
banks;. These judgea.were asked to rate. each item on \a 1 to 7 scale 
as to the degree of effectiveness the item described, rknging from very • 
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very Ineffective to extremely effective. The means of all ratings were 
calculatisd , and Itetas were retained If the standard -deviation of their 
ratings did not exceed 1.0. • Approximately 50 to 80 behavior s'amples 
per .dimension remained from each bank's Initial sample pool. Those 
Items were used to develop Behavlorally Anchored. Ratljig Scales. for each 

♦ * * > 

bank. . Since the main purpose of^e study was to develop an evaluation 
instrument which was valid for all banks, the validation' process was not 

I 

yet completed^ - ^ ' ^ . 

The remaining items from all banks were pooled according, to their " 
category, and redundant items removed.. From the remaining behavior sampl 
^50, items per job dimension were selected according to the lowest standard 
deviation criterion (i.e. highest degree of agreement among jgdges). 

These items were listed and feent to.,200 judges ^n' each bank, a total of 

I 

1,000 judges. They were asked to judge, each item as to its validity as' 

y " ' ' ' ■ ... 

a typical' job behavior of an assistant branch manager, a^nd secondly, "* *• 
to rate it on a 1 to 7 scale-.as to the degree of effectiveness it 
described in their opinion." Out ofM,000 mailed rating lis^ts,-511 
usable were returned (response rat^f 51%). items were retained if they - 
fulfilled the following requirements: 

1. 80% of all judges and '< ' • 

2. 60% of the judges o£ the individual banks agreed on the ^ 
/ validity of the item; 

3. the standard deviation of the item did not^xceed 1.5. 

n .- . 

A total of 120 items could be retained. 
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Development /of Di!ffer'ent Evaluation Instfuments * ^ 

In-line with Scl^wab, al. 's [1975] reconmiendafcion that or / * 

comparison'' purposes morfe than two instruments should be utilised, a . 

Graphic Rating Scale XGRS), a Behayio rally* Anchored Rating Scale (BARS)> 

and .a Behavior Description Index (BD'I) were developed. fhe'*GRS was 

basically the adaptation of a 7-point Vating s-^li, used by. the bajiks 

for their regul§r annual^perf ormance appraisal (see Exhibit*2). The 

BAR& and the. BDI instruments, on the other hand, were developed by using - 

. ' , ^ t 

the job behavior samples meijtioned before. 'The items for the BARS 

instrument were selected according 'to a) ratings' closest to a scale 

point (I'to 7\ and b) lowest possible standard deviation- (see Exhibit 3). 

As it turned *out, no items could 'be f^nd for the. midpoint range of the*' 

scales '(A). Th%s problem is discussed by Landy an<i Guion [1970], who ■ 

.suggest' that polarisation is a necessary' consfequepce of eliminating items 

which* do not have meaning tb individuals; • . 

^ • *• . * , , ' 

.For, the pDI instrument it was arbitrarily /decided to utilise 20" job 

^havior samples per job dimehsion, or'lOO in total. Examples of . * 

effective jind ineffective behavior were selected according to the,-loVe«t 

* ^ *• * • ^ . 

standatd deviation and listed in random order (see ExhibitTl) ' 

, As to the rating procedure, it was decided^to adapt Smith, Kendall, - 

and Hulih's. [l969i^'proach to rate the ^responses to their measure of 

job satisf^tion, the Job Description- Index- Raters may respond "Yes"\(Y'), 

*'No'\ (N), or "Undecided" (?). If a rate^r responds ppsitively tb an 

effective behavior sample, or negatively to an ineffective sample, the 

score will be -3 points. A positive response to a ^negative.- statement aSa 

^ " ' ' ' * ^ ' • . • ^ 

vice versa tesults in 0 pdints. If the respondent Is not sure or cannot 

decide, the response irs a ques^tlon mark, and tke scor^ will^be 1 point. 



' In the latter case it is assumed that when a rater> is uncertain whether 
a ratee exhibited a certain behavior or not it iudica^s a stjmewhat lower 
probability that tHe ratee will exhibit the desirable behavior* (or not 
exhibit undesirable behavior) . This is in line with the empirical 



findings by Smith, et al. [1969], who concluded that an "uncertain" 
.4 

, response was more indicative of a negative response than a positive one, 
(p. 79). . • 

.Rat^e and Rater Sample ' 

This paper- reports the results of the firat test of the new 
instrument out of a series of several ongoing tests. A group' of 25 
assistant branch managers of one of the five Canadian banks were rated 

/by their superitirs, using the GRS, BARS, aid the B^^^s^appraisal 

"I . > * r * 

^- 

instrui^ents The sample was drawn from branches in^ three Maritiijae 

' ^ ^ ^ 

provinces. Nova Scotia, Prince Edward Island, and Newfoundland, r 

■ J- 

Analyses , 

Leniency will be measured by assessing the skewness of the different 

scales [Barrett, Taylor, Parker, and Martens, 1958; Haridas, Frost, and 

< 

Barnowe, 1977], using a formula suggested by Blalock [1972]. The larger 
ithe skewness coefficient the -larger is the leniency effects. 

. Halo effect ^will be assessed by averaging the correlations between 
ratings on all job dimensions [Barrett, et al., 1958]. 
N.;^ Central Tendency will be measured* by analysing the distribution of 
the^ scores for every instrument. 

.Information Content will be assessed by calculating the percentage 
of actually used job behavior^ samples from the total available item pool 
which survived the last validation process. 
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Construct Validity vill be tested by using Cdmpbeli and Flske's [1959] 
multltralt-multlmethod matrix (15 scales x 3 methods), / 

^.^ 

Results 

» ' The means and standard deviations of the ratings are shown In Table 1, 
Since the BDI utilises a 60-polnt scale and the GRS' and 'BARS a 7-polnt ' ' 
sacle, the standardised skewness coefficient for each performance 
dimension scores of the thrSe Instruments are shown In- Table 2. An 
examination of the three skewness coefficients for each dimension reveals 
that the value for the BDI and the BARS Instrument are similar, and 
closer to zero than the result for-the GRS Instrument. 

The correlations between the different performance dimensions are 

* 

reported In Table 3. The GRS scores show a significantly higher halo 

effect than both BARS and BDI scores (p < ,05, for the GRS-BARS and 

GRS-BDI differences, according to the sign test;. the difference between 

BARS and^ BDI Is not significant). The GRS format yields 9 significant 

correlations out of 10, versus 3 for both the BARS and BDI format. By 

• ♦ 

comparing the mean correlation for each Instrument, the BDI comes out 
best with .24, as compared to .32 for the BARS and .49 for thre GRS. 

In order to measure central tendency effect of the three Instruments 
the score distribution for the five dimensions of ^ach Instr.ument Is 
shown In Table 4. It Is Interesting to see that the GRS scores contain • 
no ratings In the two lowest scale ranges ("unacceptable" and "moderate"), 
and In the highest scale rSnge ("excellent^'). For the BARS and the BDI 
Instruments only the lowest scale ranges Is not utilised. f 

The degree of utilisation of available lnformatli)n Is measured by i 
calculating the percentage of actually used behavior samples from thfe 
total available Item pool which survived the last validation process.* 



The results are shown in Table 5". The Information content for the GRS 

could not be determined since it does not use job behavior samples. The 

data show that the BDI utilised almost three times as many job behavior 

samples as the BARS, or 83 percent as compared to 30 percent for the 
m 

latter. ^ 

The final mode of analysis is the multitrait-multimethod approach 
suggested by Campbell and Fiske [1959]. The present study resulted in 
a 15 X 15 multitrait (5 • performance dimensions) multimethod *(GRS vs. 
BARS vs. BDI) matrix, shown in Table 6. Campbell and Fiske define 
convergent validity as the observation of significant correlations when 

two different methods Are used to measure the same variables. As the 

t 

results show, convergent validity ^ds significant at the p i= .05 and 01 
level for all entries but the "Training" scale in'tlj^ GRS/BARS 
correlations. 

Discriminant validity is indicated in two ways. First, the entries 
in the validity^diagonal can be compared with their corresponding row 
and column entries in the beterotrait-heteromethod triangles (indicated . 
by broken lines). This yields 8 comparisons for each perlorraance factor 
^ in which the diagonal value should be higher than the row ^nd column 
values, if discriminant validity is presents Discriminant validity is 
highest for the BARS/BDI correlations, yielding 39 (out of *40 comparisons, 
Qr 97.5 percent) with higher validity entries, as compared to 36 for^'the 
GRS-/BDI (90 percent), and 31^ for the GRS/BARS correlation (77.5 percent). 
Since both convergent and discriminant validity are established for the 
BARS and BDI instruments, it -can be concluded that both show eyidence 
of construct validity. The GRS format compares less favorably. 



A second index of discriminant validity involx^ps comparing the 

validity diagonal entries . (same traits but different methods) to the ^ 

f 

corresponding row and column entries in the hetero.tifait-monomethod 
triangles (indicated in solid lines). This implies r that the correlations 
should be higher when the different methods are used to measure the same 
dimension than when different dimensions are ijieasured by the same method. 
Discriminant validity according to the latter criterion is highest for 
the BARS and BDI instruments, yielding 17 (out of 20 comparisons) with • 
higher validity entries, as compared to only 12 for the GRS instrument. 
A chl. square test of independence indicates significantly fewer' 
exceptions for the BARS and BDI instruments as compared to the GkS 
format at the p < .01 level (x^ » 8.64; df » 1). 

A further question concerns the pattern of relationships among 
traits when measured *by the three rating methods. ;^he ranks of the 



correlations in the three monomethod triangles were compared, resulting 
in r » .31 b^etween GRS and BARS, ^r - .35 between GRS and BDI, and r - .85 
between BARS 'and BDI* Only the latter correlation is strongly 
significant, the common variance being .72, suggesting a related 
structure between the performance dimensions of the two instruments.^ 

- Conclusions . ^ ■ 

From the results of the study several — cautious — conclusions can 

^ 

be drawn. • First, behaviorally oriented scalea need not be organization 
specific. This is an Importat^t finding, similar to the one by Goodale * 
and Burke [1975] who demonstrated that BARS need^not be job specific. 
The extension of the use of behavior oriented scales to other, but 
siMXnx^ jobs^ in the same organization aij^ now even to similar jobs in 



different organizations in the same industry should make , the significantly 
higher inves^tment in time and effort for the development of- behavior 

a J ^ ^ • ^ ^ 

. ori enters cales more worthwhile. It is now possible for organizations 
to pool (their resources to develop such instrument^, or delegate/ such 

..a job to anr^stitution to which all related organizations belong as 
Dl^rabers; e.g. the Institute of Canadian Bankers, the Trust Companies 
Associaition of Canada, the Canadian Manufacturers Association, and 
others. . ' ' 

As a second result of the study, it has been ^hown that it is. 
possible to improve the psychometric characteristics of behavior oriented 
scales in several ways. One of the major shortcomings of the BARS format 
was the severely limited utilisation of the total pool of information 
'available on the job behavior domain. The switch from a Likert-type 
scale--which limited the number of behavior samples' used per scale to ' 
the number of anchor points — to -an anchorless format whi,ch allows 
theoretically the use of the total- job behavior domain, seems to be a t 
breakthroqgh in the search for a .performance appraisal instrument with 
a large and specific amount of feedback information and a superior 
rating ^characteristic than BARS* f 

And thirdly, because of* the f^avorable rating characteristics, the 
increased utilisation of job information, and the very specif ic, feedback 
to raters, evaluators, and ratees, it is possible that the BDI can be 
used as the basis or at least a significant part of a new Personnel 
Management 'System, 'utilising similar types of information in different 
areas. BDI- type of information can bemused for: * ' 



Job Descriptions, to» define scope. of activities and major' 
responsibilities connoted with a job; ^ ^ 

Job Analyses, <o' determine the behavioral aspects of a job; 
Job Specificatian, to describe required skills to perform 
a specific job adequately; , ^ > . 
Selection Aid, to check whether a "skilled" applicant 
actually possesses the skill^ for a spe.cific job; 
Determining TTraining Needs? no other instrument appears 
to be more suitable to assess ^an employee's strengths 
and weaknesses than the BDI, because no other device 
offers such specific feedback o^ areas where training 
is needed;' 

Assessment of Trainer's Effectiveness^ to* measure the 
specific strengths and weaknesses of instructors. by 
focusing on their effective and ineffective teaching' 
behavior; . ■ ^ 

» • 

Measuring. Training and Development Program Effectiveness, 
to assesrf in detail the outcomes of all types of programs 
with the aim of changing- a participant's behavior; 
Performance Appraisals, to determine an employee's strengths 
and weaknesses (shortcomings) in the job behavior domain • 
The appraisal can be used.'lEor different purposes, such as:' 

a) counseling, e.g. wherB to improve 

b) promotion, e.g. as evidence that required skills are 
demonstrated, ^ . , ' 

c) wage and salary administration, e.g. rewards could be 
• offered to those whose job behavior fulfills certain^ 

basic standards, and 



9* Assessment of Agreement on Organizational Policy, to 

measure the accuracy of communication of organizational 

policies; e.g. desirability of specific behaviors, 

specially at different organizational levels. 

It |ppears thkt the new behavior oriented evaluation scale, tftfe 

Behavior Description Index, may be a needed addition to; or perhaps 

a replacement for, some of the^ instruments or processes used so tar 

* 

in the area of Personnel Management. Only future research can tell, 
how strong Its position will be. 
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,Exhibit--]>^ 

Job Part: Administration \ 

Description of Responsibilities: quarterly analyse^ ^monthly repoi/ts. routine work, branch 
security, internal .-correspondence, correspondence wi€h other banks, cooperation with 
m<»n,vjor, dlupplits, housekeeping, repairs ^ 

,-Patin., Procedure: Please, THINK CAREFULLY before you answer the question: Does this job 
mcumben^ exhibit the in following described behavior all the time? (Does it describe 
. his tirgical behavior?) Use "Y" for Yes, "N"- for. No, ^d "?"> you are not certain. 



Delo.qatcs work to sui?ordi nates effectively by taking care that it is evenly 
. distributed according to ability and knowledge of each employee. 

lias to. borrow frequently requiredT stationaries from other branches resulting 
in delays and disruption of work flow. 

Is unable to organize his own work load, is constantly "catching yip" thus 
,5etting a poor example for others.. • b ' : 

Is very conscious^of security, and effectively controls procedures thereby 
resulting in al-ar" personnel observing "rules and regulations. 

Ensures that housek«^ing of "^king^re is neat and desks are not messy, 
thus making the Brahc5i look presentable and a pleasant pl^ce to_ do. buf in,ess . 
Drops work on^a -^subordiiValie • s desk to be completed without reviewing it ■ 
with that particular individual, causing .confusion and backlog. 

Has a high standard of letter writing, good typing, and .ensures that letters 
arc not sigped by junior personnel. •, , 

Keeps meticulous records and encoura^s^ sta^ to'do the' same, thereby 
reducing errors and rework. - . ; 

Keeps close control on cash holdings tHus miiiimizing risks and maximizing 
profits. i r . ^ 

' *> s- 
Offers sugqestions to superiors in effort to improve ef fectivensss of new 
->6«--existing policies. ^ 

IS unable to develop a good 'diary ^system, causing confusion and delays " ., 

Does not care that corre'spondence is answered daily. • 

Knows a neiw procedure well before explaining it to the staff. * 

Xeeps a check on amount of overtime and finds out" reason. 

Analyzes the duties to be performed in order that matters of high priority 
are attended to .first. • . ^ priority 

Keeps down' Administrative costs through efficiency of operation, i^e^ 
staff are profitably employed, over ordering of statfonary,' is kSTtTa 
^erS.' ' °" work ^unnecessary 

Knows his manuals well and is able to quickly find process to follow. 
Keeps management, informed 'of all' aspects of branch operation. ' • . 

Takes proper sa.feguards to combat- frauds, etc. , such as holding funds 
until cheques clear, etc. * , — 

Plans, staff ' vacation so as. to provide adequate customer service. 

{ 
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. ^ Exhibit 2 . \ 

^ Global Rating. Scale 

A tdam of training managers of S Canadian banks agreed 
that the job of a bank accountant (administration officer) can 
be divided into 5 areas: Administration, Customer Relations/ 
MarketiVig, Personnel, and Training. You are asked to give 
an overall rating of the job performance of your accountant 
(administration officer) in the 5 areas mentioned, using 
a 7 point scale. 

His performance is: 



1 2 
• } 


3 


4 


' 5 
» 


6 

1 




7 

t 


unaccept- medioci'p 
able , 

/ 


slightly 
b«?5w 
average . 


average 


slightly 
cibove , 
average 


superior 


outstanding 


Job Are^ 


Please circle the 


appropriate' number 




Administration 


1 ^ 2 


. 3 
• 


4 
» 


.5 
• 


6 

- 1 


7 


Customer Relations 


1 I 

1 •• 


3 

— - 1 , _ 


> 4 


5 . 
• 


6 

t 


1 

» 7 


Marketing 


1 2 


' 3 
• 


4- * 


5 . 


6 

. i 


L 

7 


Personnel * 


^ ^ 1- 


3 

' . r 1 .. 


4 \ 


5 
t 


6 

_ _L 


k 

• 7 ' 


Training ^ 


1 2 
J I 


3 

. • -> 


4 , 
• 


• 


6 

1 


i. ' 
7 

L 
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Exhibits • . 

Job Part: Administration 

Descriptiop/ of ResponsibiliYijss : quarterly analyses, monthly reports, 
routine work, branch security, internal corresponde^nfee , 
coifrespohdence^ with others banks, cooperation with manager, 
supplies, housekjeeping, repairs ' I 



Rating Procedure: Read eVery example of. the job incumbent's behavior 

and then put a check-mark (.^r. by the example that besti represents 
how youj:ould expect the incumbent you are rating to typically 
perform in this aspect of his jo^. - , 

^ \ . . ^ \ . - 

This Accountant (Administration Off\icer) : *' 

7. can be expected to-be conscious of security, and effecti^Aely 

controls procedures , .thereby resulting in all ,|)ersonnel 
. observing rules and regulations. 



6 • can be expected to keep down admii^istrative costs through 

efficiency of operation, i.e,., staff arfe profitably employed, 
over ordering of stationary is ke^4;to a minimum, lights ^are 
not left .on all nighty— staff^do not work -unnecessary overtime 

■5. can be expected to hav0 the -Current Account and Personal 

Chequirig- ledgers balanced daily* 

3- *can be expected not to observe deadlines for reports 

therefore causing hdsty jobs, often incorrect. 

2. can be expected to be unable to organize his own work ' 

load, constantly trying to "catch up", thus setting a poor 
example for others. 

can be expected to be -unable to develop a good diary 

system, causing confusion and delays with work. 
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TABLE 1 



MSANS AND STANDARD DEVIATIONS FOR EACH PERFORMANCE DIMENSION 
ON GRS, AOBARS, AND BDI RESPONSES 



Perfonnance 
Dimensions 


GRS 
Mean S 


.D. 

^ L 


AOBARS , 
Mean S.D. 


BDI 

Meem 


S;D. 


A 


5.16 


.98 


5.40 1/08 
* 


48.88 


5.65 , ^ 


C 


4.88 


.78 


5.50 .73 


46 .-08 


6.14 


M 


.4.12^ 


.78 


4.94 1.19 


33.80^. 




P 


4.84'- 


.89 


5.08 1.16 


47.64 


6.59 




4.80 


.81 

\ 


5.50 .82 


47.52 


6.53 








N=25 




0 


Note : A=Adminis tration 

C=Customer Relations 
M=Marketing 
P=Personnel 
T^Training 

V 


f 


GRS was 
AOBARS was 
BDI was 


scored on a 
scored on a 
scored on a 


7 point scale 
7 point scale 
60 point scdle 



' . ^ ^L"^ .TABLE 2* 

NORMALIZED SKEtfWESS COEFFICIENT FOR .EACH PERFORMANCE DIMENSION 
ON GPS,-AOBARS, AND BDI RESPONSES" , ' - 



GRS 



AOBARS 



BDI 





, -2.75 


-.55 


- .26' 




^ C 


-• - .76 . 


1.50 


-1.10 ' 


6 




'-1.90 


'-.78 


-1.90 






-l.pl ^ 


-.91 


-.20 




• 

T ^ 


-2.22^ 


.36 


1.04 . ' 


C 



Mean 



-1.72 



-.82 



N*25 



Note : 




The mean skewness coefficients were calculik^d^T^^^^tising the 
.absojLute scor^. " ^ 



The skewness coefficients were calculated accot^ing 
to' the formula 



Sk =' 



3 ( X - Md ), 

a 



X = Mean 



(Blalock, 1972) 



Md = Median ' 

4 

.0 = Standaird. deviation 
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TABLE 




CORRSXATIONS BETWEEN DIMENSION SCORES OF 
EACH OF THE THREE INSTRUMENTS 





GRS 


ADBARS 


. BDI 






' A/C 




36 


• 32 




s 


- A/M 

c 


40* 


<* 18 


-09 








7S** 


62** 


46* 






• .A/T 


61** 


44* 


51** 






C/M 


43* 


07 


00 






C/P 


, 38 


38 


32 






C/T 


41 




35 






M/P 


26 


22 


13 






M/T 


68** ' 


06 


-04 




• 


* • 


46* 


56 


48 






Mean 

* 


49 ^ 


32 

N=25 


J 

24 




• 


A=Ad:aihistration 
C=Customer' Relations 
<:=Marketing« - 
P^Personnel 
T=Training 


IS' 


*P< 
** 

P< 


• 05 




• 

» 


• 


» 






• 


* 

>• 








• 




* 

r 



ERIC 
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•TABLE 4 

C0=2 DISTRIBUTIOM FOR FIVH Dlf-ISNSIOMS 
EACH CRS, -AOBPVHS, AilD.BDI IMSTRIX^NT 



A03rtR3 . Scores . BDI 



0-10 


0 


11-20 * 


3 


21-30 


21 


31-40 


38 


41-50 


■ 34 


51-50 


29 



N=25 



( 



t f * 
TABLETS 



IMFORMATION CONTENT FOR AOBARS AND BDI AS 
MHASUHSD BY PERCENTAGE OF ACTUALLY UTILIZED 
CRITICAL INCIDENTS T90Vi TOTAL AVAILABLE INCIDENT POOL 



Total Available 
Pool 



Utilized by 
AOBARS 



Utilized by 









. 0 

# 


% 


# ^ % 




t 


120 


30 


25 


100 -^83.3 



ERIC 



2% 



TABLE 6 



MOLTITRAIT (PERf'ORMANCE DIMENSIONS ) ,\lULTIMETHOD {GRS vs. 



BARS vs. DDI) MATRIX POR DANK ACCOUNTANTS 





A ' 


C 


A 






C * 


5I\ 






40 




P 


73 


38 


T 


61 


41 



c 

M 
P 
T 

A 

P' 
M 

P 

T 



GRS 

M - P 



\ 



(50) X20 08 - 36 
'34 v^39)^-^8« 37 
3V (13*)^ 



34' 
61 



i4T 

03 
43 



32N^3)'s^9 
58 44 33V(6S^v25i 
13._.54__19l^2ys, (24) 



09 
30 



&) 'M^. -07"*~ 34 
j46\-(54)\l5- 31 
1 18 17N^f69) \13- 39 
159 13 00 0(66) \13 

I ' • N N 

ill 29_ _z06___ {6^ (45) 




I 33 (58) \ 16 37 ' 52 

1 06 • -"41^ (46) Vii 19 

I \ *> 

|62_ 35 i6\(69)'^40| 

L36_35 ^_29s, (49) 



BDI 

A C M p 




